Variable Coded Batch Matrix Multiplication
نویسندگان
چکیده
A majority of coded matrix-matrix computation literature has broadly focused in two directions: matrix partitioning for computing a single task and batch processing multiple distinct tasks. While these works provide codes with good straggler resilience fast decoding their problem spaces, would not be able to take advantage the natural redundancy re-using matrices across jobs. In this paper, we introduce Variable Coded Distributed Batch Matrix Multiplication (VCDBMM) which tasks distributed system perform multiplication where are necessarily among Inspired part by Cross-Subspace Alignment codes, develop Flexible Alignments (FCSA) that flexible enough utilize redundancy. We full characterization FCSA allow wide variety complexities including decoding. theoretically demonstrate that, under certain practical conditions, within factor 2 optimal solution when it comes resilience. Furthermore, our simulations can achieve even better optimality gaps practice, going as low 1.7.
منابع مشابه
Coded Sparse Matrix Multiplication
In a large-scale and distributed matrix multiplication problem C = AB, where C ∈ Rr×t, the coded computation plays an important role to effectively deal with “stragglers” (distributed computations that may get delayed due to few slow or faulty processors). However, existing coded schemes could destroy the significant sparsity that exists in large-scale machine learning problems, and could resul...
متن کاملFast Sparse Matrix-Vector Multiplication by Exploiting Variable Block Structure
We improve the performance of sparse matrix-vector multiply (SpMV) on modern cache-based superscalar machines when the matrix structure consists of multiple, irregularly aligned rectangular blocks. Matrices from finite element modeling applications often have this kind of structure. Our technique splits the matrix, A, into a sum, A1 + A2 + . . . + As, where each term is stored in a new data str...
متن کاملPolynomial Codes: an Optimal Design for High-Dimensional Coded Matrix Multiplication
We consider a large-scale matrix multiplication problem where the computation is carried out using a distributed system with a master node and multiple worker nodes, where each worker can store parts of the input matrices. We propose a computation strategy that leverages ideas from coding theory to design intermediate computations at the worker nodes, in order to optimally deal with straggling ...
متن کاملFast Matrix Multiplication
We give an overview of the history of fast algorithms for matrix multiplication. Along the way, we look at some other fundamental problems in algebraic complexity like polynomial evaluation. This exposition is self-contained. To make it accessible to a broad audience, we only assume a minimal mathematical background: basic linear algebra, familiarity with polynomials in several variables over r...
متن کاملMatrix Multiplication I
These notes are based on a lecture given at the Toronto Student Seminar on February 2, 2012. The material is taken mostly from the book Algebraic Complexity Theory [ACT] and the lecture notes by Bläser and Bendun [Blä]. Starred sections are the ones I didn't have time to cover. This lecture discusses the problem of multiplying two square matrices. We will be working in the algebraic complexity ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE journal on selected areas in information theory
سال: 2022
ISSN: ['2641-8770']
DOI: https://doi.org/10.1109/jsait.2022.3177609